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Display System with Sequential Color and Wobble Device 



BACKGROUND 

[0001] Many image display systems, such as monitors, projectors, or 
other image display systems, exist to display a still or motion picture video 
image. Viewers evaluate image display systems based on many criteria such 
as image size, contrast ratio, color purity, brightness, pixel color accuracy, and 
resolution. Pixel color accuracy and resolution are particularly important metrics 
in many display markets because the pixel color accuracy and resolution can 
limit the clarity and size of a displayed image. 

[0002] A conventional image display system produces a displayed 
image by addressing an array of pixels arranged in horizontal rows and vertical 
columns. Because pixels have a rectangular shape, it can be difficult to 
represent a diagonal or curved edge of an object in a image that is to be 
displayed without giving that edge a stair-stepped or jagged appearance. 
Furthermore, if one or more of the pixels of the display system is defective; the 
displayed image will be affected by the defect. For example, if a pixel of the 
display system exhibits only an "off' position, the pixel may produce a solid 
black square in the displayed image. The undesirable results of pixel geometry 
and pixel inaccuracy are accentuated when the displayed image is projected 
onto a large viewing surface in color. 

[0003] Many display systems create a full color display with a single 
modulator by creating three or more modulated images in primary colors (red, 
green, and blue) per video frame. The primary colors are typically derived from 
a white light source using a color wheel, prism, or some other color filter. The 
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modulated images are sequentially displayed at a high rate so as to create a full 
color image in the human visual system. Thus, this method of generating a full 
color display is called "sequential color." However, in some sequential color 
systems, undesirable visual artifacts such as flicker may occur during the 
display of an image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0004] The accompanying drawings illustrate various embodiments of 
the present invention and are a part of the specification. The illustrated 
embodiments are merely examples of the present invention and do not limit the 
scope of the invention. 

[0005] Fig. 1 illustrates an exemplary display system according to one 
exemplary embodiment. 

[0006] Fig. 2 illustrates the generation of a displayed image using 
sequential color according to one exemplary embodiment. 

[0007] Fig. 3 illustrates an exemplary sequential color device 
according to one exemplary embodiment. 

[0008] Fig. 4 illustrates an exemplary display system with an 
expanded view of exemplary functions inside the image processing unit 
according to one exemplary embodiment. 

[0009] Figs. 5A-C illustrate that a number of image sub-frames may 
be generated for a particular image according to one exemplary embodiment. 

[0010] Figs. 6A-B illustrate displaying a pixel from the first sub-frame 
in a first image sub-frame location and displaying a pixel from the second sub- 
frame in the second image sub-frame location according to one exemplary 
embodiment. 

[0011] Figs. 7A-D illustrate that the sub-frame generation function 
may define four image sub-frames for an image frame according to one 
exemplary embodiment. 
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[0012] Figs. 8A-D illustrate displaying a pixel from the first sub-frame 
in a first image sub-frame location, displaying a pixel from the second sub- 
frame in a second image sub-frame location, displaying a pixel from the third 
sub-frame in a third image sub-frame location, and displaying a pixel from the 
fourth sub-frame in a fourth image sub-frame location according to one 
exemplary embodiment. 

[0013] Fig. 9 illustrates an exemplary embodiment wherein the 
wobbling device shifts the display position of the image sub-frames between 
two image sub-frame locations. 

[0014] Fig. 10 illustrates an exemplary embodiment wherein the 
wobbling device vertically shifts the display position of the image sub-frames 
between two image sub-frame locations. 

[0015] Fig. 1 1 illustrates an exemplary embodiment wherein the 
wobbling device horizontally shifts the display position of the image sub-frames 
between two image sub-frame locations according to one exemplary 
embodiment. 

[0016] Fig. 12 illustrates an exemplary embodiment wherein the 
wobbling device shifts the display position of the image sub-frames between 
four image sub-frame locations according to one exemplary embodiment. 

[0017] Fig. 13 illustrates an exemplary alternative embodiment 
wherein the wobbling device shifts the display position of the image sub-frames 
between four image sub-frame locations such that two of the primary colors are 
displayed in the same image sub-frame location before the third primary color is 
displayed in a different image sub-frame location according to one exemplary 
embodiment. 

[0018] Fig. 14 illustrates another exemplary alternative embodiment 
wherein the wobbling device shifts the display position of the image sub-frames 
between four image sub-frame locations such that two of the primary colors are 
displayed in the same image sub-frame location before the third primary color is 
displayed in a different image sub-frame location according to one exemplary 
embodiment. 
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[0019] Fig. 15 illustrates an second exemplary embodiment wherein 
the wobbling device shifts the display position of the image sub-frames between 
four image sub-frame locations. 

[0020] Throughout the drawings, identical reference numbers 
designate similar, but not necessarily identical, elements. 

DETAILED DESCRIPTION 

[0021] In the following description, for purposes of explanation, 
numerous specific details are set forth in order to provide a thorough 
understanding of the present display system. It will be apparent; however, to 
one skilled in the art that the present display system may be practiced without 
these specific details. Reference in the specification to "one embodiment" or 
"an embodiment" means that a particular feature, structure, or characteristic 
described in connection with the embodiment is included in at least one 
embodiment. The appearance of the phrase "in one embodiment" in various 
places in the specification are not necessarily all referring to the same 
embodiment. 

[0022] The term "display system" will be used herein and in the 
appended claims, unless otherwise specifically denoted, to refer to a projector, 
projection system, image display system, television system, video monitor, 
computer monitor system, or any other system configured to display an image. 
The image may be a still image, a series of images, or motion picture video. 
The term "image" will be used herein and in the appended claims, unless 
otherwise specifically denoted, to refer broadly to a still image, series of images, 
motion picture video, or anything else that is displayed by a display system. 

[0023] Fig. 1 illustrates an exemplary display system (100) according 
to an exemplary embodiment. The components of Fig. 1 are exemplary only 
and may be modified or changed as best serves a particular application. As 
shown in Fig. 1, image data is input into an image processing unit (106). The 
image data defines an image that is to be displayed by the display system 
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(100). While one image is illustrated and described as being processed by the 
image processing unit (106), it will be understood by one skilled in the art that a 
plurality or series of images, or motion picture video, may be processed by the 
image processing unit (106). The image processing unit (106) performs various 
functions including controlling the illumination of a light source (101) and 
controlling a spatial light modulator (SLM) (103). The image processing unit 
(106) will be explained in more detail below. 

[0024] As shown in Fig. 1 , the light source (101 ), provides a beam of 
light to a sequential color device (102). The light source (101) may be, but is 
not limited to, a high pressure mercury lamp. The sequential color device (102) 
enables the display system (100) to display a color image. The sequential color 
device (102) may be a set of rotating prisms, a color wheel, or any other device 
capable of providing sequential color. Sequential color and the sequential color 
device (102) will be explained in more detail below. 

[0025] Light transmitted by the sequential color device (102) is 
focused onto the spatial light modulator (SLM) (103) through a lens or through 
some other device (not shown). SLMs are devices that modulate incident light in 
a spatial pattern corresponding to an electrical or optical input. The terms 
"SLM" and "modulator" will be used interchangeably herein to refer to a spatial 
light modulator. The incident light may be modulated in its phase, intensity, 
polarization, or direction by the modulator (103). Thus, the SLM (103) of Fig. 1 
modulates the light output by the sequential color device (102) based on input 
from the image processing unit (106) to form an image bearing beam of light 
that is eventually displayed by display optics (105) on a viewing surface (not 
shown). The display optics (105) may comprise any device configured to 
display or project an image. For example, the display optics (105) may be, but 
are not limited to, a lens configured to project and focus an image onto a 
viewing surface. The viewing surface may be, but is not limited to, a screen, 
television, wall, liquid crystal display (LCD), or computer monitor. Alternatively, 
the display optics may include a view surface onto which the image is projected. 
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[0026] The SLM (103) may be, but is not limited to, a liquid crystal on 
silicon (LCOS) array or a micromirror array. LCOS and micromirror arrays are 
known in the art and will not be explained in detail in the present specification. 
An exemplary, but not exclusive, LCOS array is the Philips™ LCOS modulator. 
An exemplary, but not exclusive, micromirror array is the Digital Light 
Processing (DLP) chip available from Texas Instruments™ Inc. 

[0027] Returning to Fig. 1 , before the display optics (105) display the 
image, the modulated light may be passed through a "wobbling" device (104), 
according to an exemplary embodiment. A wobbling device, as will be 
described in detail below, is a device that is configured to enhance image 
resolution and hide pixel inaccuracies. An exemplary, but not exclusive, 
wobbling device (104) is a galvanometer mirror. The wobbling device (104) 
may be integrated into the SLM (103) or some other component of the display 
system (100) in alternative embodiments. 

[0028] Fig. 2 will be used to illustrate the generation of a displayed 
image using sequential color. In the example of Fig. 2, the sequential color 
device (102; Fig. 1) uses the three primary colors — red, green, and blue. As 
previously mentioned, a sequential color device (102; Fig. 1) used in 
combination with a modulator (103; Fig. 1) enables the display system (100; 
Fig. 1) to display an image in full color. Sequential color display systems take 
advantage of the relatively slow response time of the human eye to produce a 
full color image. Each frame period is divided into at least three periods. 
During each of these periods, a primary color image is produced. If the primary 
color images are produced in rapid succession, the eye will perceive a single 
full-color-image. 

[0029] Fig. 2 shows the face (1 1 3) of a modulator at different times 
between t 0 and t 3 . As shown in Fig. 2, only one color of light is shown on the 
modulator face (1 1 3) during each time period. For example, between times to 
and ti, the sequential color device (102; Fig. 1) causes red light (1 14) to be 
shown onto the modulator face (1 1 3). The modulator face (1 1 3) may be, but is 
not limited to, a LCOS panel or the surface of a micromirror array, for example. 
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Consequently, during the first time period (t 0 through ti), the modulator (103; 
Fig. 1) generates a red image. Between times t| and t 2 , the sequential color 
device (102; Fig. 1) causes green light (115) to be shown onto the modulator 
face (113). During this second time period, the modulator (103; Fig. 1) 
generates a green image. Finally, between times t 2 and t 3 , the sequential color 
device (102; Fig. 1) causes blue light (116) to be shown onto the modulator face 

(1 1 3) . During this final time period, the modulator (1 03; Fig. 1 ) generates a blue 
image. The red, green, and blue images are then sequentially displayed to 
form the displayed, full-color image. The primary colors may be sequentially 
shown on the modulator face (113) for subsequent images that are to be 
displayed. 

[0030] Fig. 2 shows three colors being used by the sequential color 
device (102; Fig. 1) for explanatory purposes only. In an alternative 
embodiment, more, fewer or different colors than just the primary colors may be 
sequentially shown on the modulator face (113) for an image that is to be 
displayed. For example, the sequential color device (102; Fig. 1) may break the 
light emitted from the light source (101; Fig. 1) into red, green, blue, yellow, and 
cyan colors. The number of colors used in a sequential color display system will 
vary as best serves a particular application. 

[0031] Fig. 3 illustrates an exemplary sequential color device (102), 
according to an exemplary embodiment. The sequential color device (102) of 
Fig. 3 is one of many different sequential color devices that may be used to 
effectuate sequential color in a display system. The exemplary sequential color 
device (102) of Fig. 3 is a color wheel that spins about a central axis. The color 
wheel is divided into a red (1 14) filter region, a green filter region (115), and a 
blue (116) filter region. Each filter region only allows its respective color of light 
to pass through the color wheel by blocking the transmission of undesired light 
wavelengths. For example, if a beam of white light is focused onto the red 

(1 14) filter region, only red light will be allowed to pass through the color wheel. 
The color wheel is configured to spin such that a sequence of red (1 14), green 

(115) , and blue (116) light is passed to the modulator (103; Fig. 1). In other 
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embodiments, the color wheel may provide these colors in a different sequence 
or a different set of sequential colors. 

[0032] Fig. 4 illustrates the same display system (100) of Fig. 1 with 
an expanded view of exemplary functions inside the image processing unit 
(106). In one embodiment, as shown in Fig. 4, the image processing unit (106) 
comprises a frame rate conversion unit (150) and an image frame buffer (153). 
As described below, the frame rate conversion unit (150) and the image frame 
buffer (153) receive and buffer the image data to create an image frame 
corresponding to the image data. In addition, the image processing unit (106) 
may further comprise a resolution adjustment function (1 51 ), a sub-frame 
generation function (152), and a system timing unit (154). The resolution 
adjustment function (151), as will be explained below, adjusts the resolution of 
the frame to match the resolution capability of the display system (100). The 
sub-frame generation function (152) processes the image frame data to define 
one or more image sub-frames corresponding to the image frame. The sub- 
frames, as will be explained below, are displayed by the display system (100) to 
produce a displayed image. The system timing unit (154), as will also be 
explained below, may synchronize the timing of the various components of the 
display system (100). 

[0033] The image processing unit (106), including the frame rate 
conversion unit (150), the resolution adjustment function (151), the sub-frame 
generation function (152), and/or the system timing unit (154), includes 
hardware, software, firmware, or a combination of these. In one embodiment, 
one or more components of the image processing unit (106) are included in a 
computer, computer server, or other microprocessor-based system capable of 
performing a sequence of logic operations. In addition, the image processing 
may be distributed throughout the display system (100) with individual portions 
of the image processing unit (106) being implemented in separate system 
components. 

[0034] According to one embodiment, the image data may comprise 
digital image data, analog image data, or a combination of analog and digital 
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data. The image processing unit (106) may be configured to receive and 
process digital image data and/or analog image data. 

[0035] The frame rate conversion unit (150) receives the image data 
corresponding to an image that is to be displayed by the display system (100) 
and buffers or stores the image data in the image frame buffer (153). More 
specifically, the frame rate conversion unit (150) receives image data 
representing individual lines or fields of the image and buffers the image data in 
the image frame buffer (1 53) to create an image frame that corresponds to the 
image that is to be displayed by the display system (100). The image frame 
buffer (153) may buffer the image data by receiving and storing all of the image 
data corresponding to the image frame and the frame rate conversion unit (150) 
may generate the image frame by subsequently retrieving or extracting all of the 
image data for the image frame from the image frame buffer (153). As such, 
the image frame is defined to comprise a plurality of individual lines or fields of 
image data representing an entirety of the image that is to be displayed by the 
display system (100). Thus, the image frame includes a plurality of columns 
and a plurality of rows of individual pixels representing the image that is to be 
displayed by the display system (100). 

[0036] The frame rate conversion unit (1 50) and the image frame 
buffer (153) can receive and process image data as progressive image data 
and/or interlaced image data. With progressive image data, the frame rate 
conversion unit (150) and the image frame buffer (153) receive and store 
sequential fields of image data for the image. Thus, the frame rate conversion 
unit (150) creates the image frame by retrieving the sequential fields of the 
image data for the image. With interlaced image data, the frame rate 
conversion unit (150) and the image frame buffer (153) receive and store the 
odd fields and the even fields of the image data for the image. For example, all 
of the odd fields of the image data are received and stored and all of the even 
fields of the image data are received and stored. As such, the frame rate 
conversion unit (150) de-interlaces the image data and creates the image frame 
by retrieving the odd and even fields of the image data for the image. 
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[0037] The image frame buffer (1 53) includes memory for storing the 
image data for one or more image frames of respective images. For example, 
the image frame buffer (153) may comprise non-volatile memory such as a hard 
disk drive or other persistent storage device or include volatile memory such as 
random access memory (RAM). 

[0038] By receiving the image data at the frame rate conversion unit 
(150) and buffering the image data in the image frame buffer (153), the input 
timing of the image data can be decoupled from timing requirements of the 
remaining components in the display system (100) (e.g.; the SLM (103), the 
wobbling device (104), and the display optics (105)). More specifically, since 
the image data for the image frame is received and stored by the image frame 
buffer (153), the image data may be received at any input rate. As such, the 
frame rate of the image frame may be converted to the timing requirement of 
the remaining components in the display system (100). For example, the image 
data may be received by the image processing unit (106) at a rate of 30 frames 
per second while the SLM (103) may be configured to operate at 60 frames per 
second. In this case, the frame rate conversion unit (150) converts the frame 
rate from 30 frames per second to 60 frames per second. 

[0039] In one embodiment, the image processing unit (106) may 
include a resolution adjustment function (151) and a sub-frame generation unit 
(152). As described below, the resolution adjustment function (151) receives 
image data for an image frame and adjusts a resolution of the image data. 
More specifically, the image processing unit (106) receives image data for the 
image frame at an original resolution and processes the image data to match 
the resolution that the display system (100) is configured to display. In an 
exemplary embodiment, the image processing unit (106) increases, decreases, ^ 
and/or leaves unaltered the resolution of the image data so as to match the 
resolution that the display system (100) is configured to display. 

[0040] In one embodiment, the sub-frame generation unit (152) 
receives and processes image data for an image frame and defines a number 
of image sub-frames corresponding to the image frame. If the resolution 
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adjustment unit (151) has adjusted the resolution of the image data, the sub- 
frame generation unit (152) receives the image data at the adjusted resolution. 
Each of the image sub-frames comprises a data array or matrix that represents 
a subset of the image data corresponding to the image that is to be displayed. 
The data arrays comprise pixel data defining the content of pixels in a pixel area 
equal to the pixel area of the corresponding image frame. Because, as will be 
explained below, each image sub-frame is displayed in spatially different image 
sub-frame locations, each of the image sub-frames' data arrays comprise 
slightly different pixel data. In one embodiment, the image processing unit 
(106) may only generate image sub-frames corresponding to an image that is to 
be displayed as opposed to generating both an image frame and corresponding 
image sub-frames. The image sub-frames will now be explained in more detail. 

[0041] As mentioned, each image sub-frame in a group of image sub- 
frames corresponding to an image frame comprises a matrix or array of pixel 
data corresponding to an image to be displayed. In one embodiment, each 
image sub-frame is input to the SLM (103). The SLM (103) modulates a light 
beam in accordance with the sub-frames and generates a light beam bearing 
the sub-frames. The light beam bearing the individual image sub-frames is 
eventually displayed by the display optics (105) to create a displayed image. 
However, after light corresponding to each image sub-frame in a group of sub- 
frames is modulated by the SLM (103) and before each image sub-frame is 
displayed by the display optics (105), the wobbling device (104) shifts the 
position of the light path between the SLM (103) and the display optics (105). 
In other words, the wobbling device shifts the pixels such that each image sub- 
frame is displayed by the display optics (105) in a slightly different spatial 
position than the previously displayed image sub-frame. Thus, because the 
image sub-frames corresponding to a given image are spatially offset from one 
another, each image sub-frame includes different pixels and/or portions of 
pixels. The wobbling device (104) may shift the pixels such that the image sub- 
frames are offset from each other by a vertical distance and/or by a horizontal 
distance, as will be described below. 
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[0042] According to an exemplary embodiment, each of the image 
sub-frames in a group of sub-frames corresponding to an image is displayed by 
the display optics (105) at a high rate such that the human eye cannot detect 
the rapid succession between the image sub-frames. Instead, the rapid 
succession of the image sub-frames appears as a single displayed image. As 
will now be described in detail, by sequentially displaying the image sub-frames 
in spatially different positions, the apparent resolution of the finally displayed 
image is enhanced. 

[0043] Figs. 5-8 will be used to illustrate an exemplary spatial 
displacement of image sub-frames by an exemplary wobbling device. It will 
then be shown that sequential color may be combined with the spatial 
displacement of the image sub-frames to produce a displayed color image. 

[0044] Figs. 5A-C illustrate an exemplary embodiment wherein a 
number of image sub-frames are generated for a particular image. As 
illustrated in Figs. 5A-C, the exemplary image processing unit (106) generates 
two image sub-frames for a particular image. More specifically, the image 
processing unit (106) generates a first sub-frame (160) and a second sub-frame 
(161) for the image frame. Although the image sub-frames in this example and 
in subsequent examples are generated by the image processing unit (106), it 
will be understood that the image sub-frames may be generated by the sub- 
frame generation function (152) or by a different component of the display 
system (100). The first sub-frame (160) and the second sub-frame (161) each 
comprise a data array of a subset of the image data for the corresponding 
image frame. Although the exemplary image processing unit (106) generates 
two image sub-frames in the example of Figs. 5A-C, it will be understood that 
two image sub-frames are an exemplary number of image sub-frames that may 
be generated by the image processing unit (106) and that any number of image 
sub-frames may be generated in other embodiments. 

[0045] As illustrated in Fig. 5B, the first image sub-frame (160) is 
displayed in a first image sub-frame location (185). The second sub-frame 
(161) is displayed in a second image sub-frame location (186) that is offset from 
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the first sub-frame location (185) by a vertical distance (163) and a horizontal 
distance (164). As such, the second sub-frame (161 ) is spatially offset from the 
first sub-frame (160) by a predetermined distance. In one illustrative 
embodiment, as shown in Fig. 5C, the vertical distance (163) and horizontal 
distance (164) are each approximately one-half of one pixel. However, the 
spatial offset distance between the first image sub-frame location (185) and the 
second image sub-frame location (186) may vary as best serves a particular 
application. In an alternative embodiment, the first sub-frame (160) and the 
second sub-frame (161 ) may only be offset in either the vertical direction or in 
the horizontal direction in an alternative embodiment. In one embodiment, the 
wobbling device (104; Fig. 4) is configured to offset the beam of light between 
the SLM (103; Fig. 4) and the display optics (105; Fig. 4) such that the first and 
second sub-frames (160, 161; Fig. 5) are spatially offset from each other. 

[0046] As illustrated in Fig. 5C, the display system (100; Fig. 4) 
alternates between displaying the first sub-frame (160) in the first image sub- 
frame location (185) and displaying the second sub-frame (161) in the second 
image sub-frame location (186) that is spatially offset from the first image sub- 
frame location (185). More specifically, the wobbling device (104; Fig. 4) shifts 
the display of the second sub-frame (161) relative to the display of the first sub- 
frame (160) by the vertical distance (163) and by the horizontal distance (164). 
As such, the pixels of the first sub-frame (160) overlap the pixels of the second 
sub-frame (161). In one embodiment, the display system (100; Fig. 4) 
completes one cycle of displaying the first sub-frame (160) in the first image 
sub-frame location (185) and displaying the second sub-frame (161) in the 
second image sub-frame location (186) resulting in a displayed image with an 
enhanced apparent resolution. Thus, the second sub-frame (161) is spatially 
and temporally displaced relative to the first sub-frame (160). However the two 
sub-frames are seen together by an observer as an enhanced single image. 

[0047] Figs. 6A-B illustrate an exemplary embodiment of completing 
one cycle of displaying a pixel (170) from the first sub-frame (160) in the first 
image sub-frame location (185) and displaying a pixel (171) from the second 

13 



200312853 



sub-frame (161) in the second image sub-frame location (186). Fig. 6A 
illustrates the display of the pixel (170) from the first sub-frame (160) in the first 
image sub-frame location (185). Fig. 6B illustrates the display of the pixel (171) 
from the second sub-frame (161) in the second image sub-frame location (186). 
In Fig. 6B, the first image sub-frame location (185) is illustrated by dashed 
lines. 

[0048] Thus, by generating a first and second sub-frame (160, 161) 
and displaying the two sub-frames in the spatially offset manner as illustrated in 
Figs 5A-C and Figs. 6A-B, twice the amount of pixel data is used to create the 
finally displayed image as compared to the amount of pixel data used to create 
a finally displayed image without using the image sub-frames. Accordingly, with 
two-position processing, the resolution of the finally displayed image is 
increased by a factor of approximately 1 .4 or the square root of two. 

[0049] In another embodiment, as illustrated in Figs. 7A-D, the image 
processing unit (106) defines four image sub-frames for an image frame. More 
specifically, the image processing unit (106) defines a first sub-frame (160), a 
second sub-frame (161), a third sub-frame (180), and a fourth sub-frame (181) 
for the image frame. As such, the first sub-frame (160), the second sub-frame 
(161), the third sub-frame (180), and the fourth sub-frame (181) each comprise 
a data array of a subset of the image data for the corresponding image frame. 

[0050] In one embodiment, as illustrated in Fig. 7B-D, the first image 
sub-frame (160) is displayed in a first image sub-frame location (185). The 
second image sub-frame (161) is displayed in a second image sub-frame 
location (186) that is offset from the first sub-frame location (185) by a vertical 
distance (163) and a horizontal distance (164). The third sub-frame (180) is 
displayed in a third image sub-frame location (187) that is offset from the first 
sub-frame location (185) by a horizontal distance (182). The horizontal 
distance (182) may be, for example, the same distance as the horizontal 
distance (164). The fourth sub-frame (181) is displayed in a fourth image sub- 
frame location (188) that is offset from the first sub-frame location (185) by a 
vertical distance (183). The vertical distance (183) may be, for example, the 
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same distance as the vertical distance (163). As such, the second sub-frame 
(161), the third sub-frame (180), and the fourth sub-frame (181) are each 
spatially offset from each other and spatially offset from the first sub-frame 
(160) by a predetermined distance. In one illustrative embodiment, the vertical 
distance (163), the horizontal distance (164), the horizontal distance (182), and 
the vertical distance (183) are each approximately one-half of one pixel. 
However, the spatial offset distance between the four sub-frames may vary as 
best serves a particular application. In one embodiment, the wobbling device 
(104; Fig. 4) is configured to offset the beam of light between the SLM (103; 
Fig. 4) and the display optics (105; Fig. 4) such that the first, second, third, and 
fourth sub-frames (160, 161, 180, 181; Fig. 5) are spatially offset from each 
other. 

[0051] In one embodiment, the display system (100; Fig. 4) completes 
one cycle of displaying the first sub-frame (160) in the first image sub-frame 
location (185), displaying the second sub-frame (161) in the second image sub- 
frame location (186), displaying the third sub-frame (180) in the third image sub- 
frame location (187), and displaying the fourth sub-frame (181) in the fourth 
image sub-frame location (188) resulting in a displayed image with an 
enhanced apparent resolution. Thus the second sub-frame (161), the third sub- 
frame (180), and the fourth sub-frame (181) are spatially and temporally 
displaced relative to each other and relative to first sub-frame (160). 

[0052] Figs. 8A-D illustrate an exemplary embodiment of completing 
one cycle of displaying a pixel (170) from the first sub-frame (160) in the first 
image sub-frame location (185), displaying a pixel (171) from the second sub- 
frame (161) in the second image sub-frame location (186), displaying a pixel 
(190) from the third sub-frame (180) in the third image sub-frame location (187), 
and displaying a pixel (191) from the fourth sub-frame (170) in the fourth image 
sub-frame location (188). Fig. 8A illustrates the display of the pixel (170) from 
the first sub-frame (160) in the first image sub-frame location (185). Fig. 8B 
illustrates the display of the pixel (171) from the second sub-frame (161) in the 
second image sub-frame location (186) (with the first image sub-frame location 
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being illustrated by dashed lines). Fig. 8C illustrates the display of the pixel 
(190) from the third sub-frame (180) in the third image sub-frame location (187) 
(with the first position and the second position being illustrated by dashed lines). 
Finally, Fig. 8D illustrates the display of the pixel (191) from the fourth sub- 
frame (170) in the fourth image sub-frame location (188) (with the first position, 
the second position, and the third position being illustrated by dashed lines). 

[0053] Thus, by generating four image sub-frames and displaying the 
four sub-frames in the spatially offset manner as illustrated in Figs. 7A-D and 
Figs. 8A-D, four times the amount of pixel data is used to create the finally 
displayed image as compared to the amount of pixel data used to create a 
finally displayed image without using the image sub-frames. Accordingly, with 
four-position processing, the resolution of the finally displayed image is 
increased by a factor of two or the square root of four. 

[0054] Thus, as shown by the examples in Figs. 5-8, by generating a 
number of image sub-frames for an image frame and spatially and temporally 
displaying the image sub-frames relative to each other, the display system (100; 
Fig. 4) can produce a displayed image with a resolution greater than that which 
the SLM (103; Fig. 4) is configured to display. In one illustrative embodiment, 
for example, with image data having a resolution of 800 pixels by 600 pixels and 
the SLM (103; Fig. 4) having a resolution of 800 pixels by 600 pixels, four- 
position processing by the display system (100; Fig. 5) with resolution 
adjustment of the image data produces a displayed image with a resolution of 
1600 pixels by 1200 pixels. 

[0055] In addition, by overlapping pixels of image sub-frames, the 
display system (100; Fig. 4) may reduce the undesirable visual effects caused 
by a defective pixel. For example, if four sub-frames are generated by the 
image processing unit (106; Fig. 4) and displayed in offset positions relative to 
each other, the four sub-frames effectively diffuse the undesirable effect of the 
defective pixel because a different portion of the image that is to be displayed is 
associated with the defective pixel in each sub-frame. A defective pixel is 
defined to include an aberrant or inoperative display pixel such as a pixel which 
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exhibits only an "on" or "off" position, a pixel which produces less intensity or 
more intensity than intended, and/or a pixel with inconsistent or random 
operation. 

[0056] As mentioned, a sequential color device may be used in 
combination with a wobbling device to produce a color image with enhanced 
resolution. To facilitate sequential color, the image processing unit (106; Fig. 4) 
generates an image sub-frame for each color that is to be displayed in each 
image sub-frame location. For example, as shown in Fig. 9, if the sequential 
color device (102; Fig. 4) is configured to sequentially apply the primary colors 
to image sub-frames that are provided to the modulator (103; Fig. 4) and if the 
wobbling device (104; Fig. 4) is configured to alternate the display of the image 
sub-frames between two different spatial locations, the image processing unit 
(106; Fig. 4) generates three image sub-frames for the first image sub-frame 
location (185) and three image sub-frames for the second image sub-frame 
location (186). In one embodiment, the sequential color device (102; Fig. 4) 
and the wobbling device (104; Fig. 4) are configured such that a red (1 14) 
image sub-frame, a green (115) image sub-frame, and a blue (116) image sub- 
frame are each displayed in both the first image sub-frame location (185) and in 
the second image sub-frame location (186). 

[0057] In one embodiment, as shown in Fig. 9, the wobbling device 
(104; Fig. 4) shifts the display position of the image sub-frames between each 
color change. For example, Fig. 9 shows a sequence of six image sub-frames 
that are displayed in alternating spatial positions. First, a red image sub-frame 
(1 14a) is displayed in the first image sub-frame location (185) between times t 0 
and t|. The wobbling device (104; Fig. 4) then shifts the position of the light 
beam bearing the image sub-frames such that the next image sub-frame, which 
is a green image sub-frame (1 15a), is displayed in the second image sub-frame 
location (186) between times ti and t 2 . The wobbling device (104; Fig. 4) then 
shifts the position of the light beam bearing the image sub-frames such that the 
next image sub-frame, which is a blue image sub-frame (116a), is displayed in 
the first image sub-frame location (185) between times t 2 and t 3 . This process 
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of alternating the position of the image sub-frames is repeated for the remaining 
image sub-frames that are to be displayed. Thus, a second red image sub- 
frame (114b) is displayed in the second image sub-frame location (186) 
between times t 3 and U, a second green image sub-frame (1 15b) is displayed in 
the first image sub-frame location (185) between times U and t 5 , and a second 
blue image sub-frame (1 16b) is displayed in the second image sub-frame 
location (186) between times t 5 and t 6 . The order in which the primary colors 
are displayed may vary as best serves a particular application. For example, 
blue may be displayed first instead of red. Furthermore, red, green, and blue 
are exemplary colors that may be sequentially displayed. It will be understood 
that any combination of colors may be sequentially displayed. 

[0058] Although Fig. 9 shows the image sub-frames shifting 
diagonally between the first and second image sub-frame locations (185, 186), 
the image sub-frames may also shift vertically or horizontally. Fig. 10 illustrates 
an exemplary embodiment wherein the wobbling device vertically shifts the 
display position of the image sub-frames between two image sub-frame 
locations. Fig. 1 1 illustrates an exemplary embodiment wherein the wobbling 
device horizontally shifts the display position of the image sub-frames between 
two image sub-frame locations. 

[0059] The shifting of image sub-frames between two image sub- 
frame locations illustrated in Figs. 9-1 1 is exemplary only and is not limited to 
two image sub-frame locations. Rather, the image sub-frames may be shifted 
and displayed in any of a number image sub-frame locations. In general, if "n" 
represents the number of image sub-frame locations and "m" represents the 
number of colors generated by the sequential color device (1 02; Fig. 4), the 
image processing unit (106; Fig. 4) generates n*m image sub-frames 
corresponding to an image that is to be displayed, where n*m is n multiplied by 
m. The n*m image sub-frames are sequentially displayed and evenly 
distributed among the n sub-frame locations. Thus, m sub-frames will be 
displayed in each of the n image sub-frame locations. 
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[0060] For example, if there are four image sub-frame locations (i.e.; 
n=4), as in Fig. 12, and if the sequential color device (102; Fig. 4) generates the 
three primary colors (i.e.; m=3), the image processing unit (106; Fig. 4) 
generates twelve image sub-frames corresponding to the image that is to be 
displayed. In one embodiment, the display position of the twelve image sub- 
frames is shifted by the wobbling device (104; Fig. 4) between each color 
change such that each color image sub-frame is displayed in one of the four 
image sub-frame locations. The exact sequence and positioning of the image 
sub-frames will vary as best serves a particular application. 

[0061] Fig. 12 illustrates an exemplary embodiment wherein the 
wobbling device (104; Fig. 4) shifts the display position of the image sub-frames 
between four image sub-frame locations. First, a red image sub-frame (1 14a) is 
displayed in the first image sub-frame location (185) between times t 0 and t|. 
The wobbling device (104; Fig. 4) then shifts the position of the light beam 
bearing the image sub-frames such that the next image sub-frame, which is a 
green image sub-frame (115a), is displayed in the second image sub-frame 
location (186) between times t| and t 2 . The wobbling device (104; Fig. 4) then 
shifts the position of the light beam bearing the image sub-frames such that the 
next image sub-frame, which is a blue image sub-frame (1 16a), is displayed in 
the third image sub-frame location (187) between times t 2 and t 3 . The wobbling 
device (104; Fig. 4) then shifts the position of the light beam bearing the image 
sub-frames such that the next image sub-frame, which is a second red image 
sub-frame (1 14b), is displayed in the fourth image sub-frame location (188) 
between times t 3 and U. This process of alternating the position of the image 
sub-frames is repeated for the remaining image sub-frames that are to be 
displayed (not shown). Thus, a second green image sub-frame is displayed in 
the first image sub-frame location (185), a second blue image sub-frame is 
displayed in the second image sub-frame location (186), a third red image sub- 
frame is displayed in the third image sub-frame location (187), a third green 
image sub-frame is displayed in the fourth image sub-frame location (188), a 
third blue image sub-frame is displayed in the first image sub-frame location 
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(185), a fourth red image sub-frame is displayed in the second image sub-frame 
location (186), a fourth green image sub-frame is displayed in the third image 
sub-frame location (187), and a fourth blue image sub-frame is displayed in the 
fourth image sub-frame location (188). The order in which the primary colors 
are displayed may vary as best serves a particular application. For example, 
blue may be displayed first instead of red. Furthermore, red, green, and blue 
are exemplary colors that may be sequentially displayed. It will be understood 
that any combination of colors may be sequentially displayed. 

[0062] As mentioned, the pattern in which the wobbling device (104; 
Fig. 4) causes the image sub-frames to be displayed in Fig. 12 is exemplary 
only. As will be understood by one skilled in the art, a number of possible 
patterns may be used by the wobbling device (104; Fig. 4) to cause the image 
sub-frames to be displayed in different spatial locations. For example, in one of 
many alternative embodiments, the first image sub-frame may be displayed in 
the first image sub-frame location (185), the second image sub-frame in the 
second image sub-frame location (186), the third image sub-frame in the first 
image sub-frame location (185), the fourth image sub-frame in the second 
image sub-frame location (186), the fifth image sub-frame in the first image sub- 
frame location (185), the sixth image sub-frame in the second image sub-frame 
location (186), the seventh image sub-frame in the third image sub-frame 
location (187), the eighth image sub-frame in the fourth image sub-frame 
location (188), the ninth image sub-frame in the third image sub-frame location 
(187), the tenth image sub-frame in the fourth image sub-frame location (188), 
the eleventh image sub-frame in the third image sub-frame location (187), and 
the twelfth image sub-frame in the fourth image sub-frame location (188). 

[0063] Fig. 13 illustrates an exemplary alternative embodiment 
wherein the wobbling device (104; Fig. 4) shifts the display position of the image 
sub-frames between four image sub-frame locations. Fig. 13 shows that the 
wobbling device (104; Fig. 4) shifts the position of the light beam bearing the 
image sub-frames such that two of the primary colors are displayed in the same 
image sub-frame location before the third primary color is displayed in a 
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different image sub-frame location. Displaying two of the primary colors in a 
particular image sub-frame location and then displaying the third primary color 
in a new image sub-frame location is advantageous in many exemplary display 
systems. For example, Fig. 13 shows that red and blue image sub-frames are 
displayed in the first image sub-frame location (185) between times t 0 and t 2 . 
The wobbling device (104; Fig. 4) then shifts the position of the light beam 
bearing the image sub-frames such that the next image sub-frame, which is a 
green image sub-frame, is displayed in the third image sub-frame location (187) 
between times t 2 and t 3 . The wobbling device (104; Fig. 4) then shifts the 
position of the light beam bearing the image sub-frames such that the next two 
image sub-frames, which are red and blue image sub-frames, are displayed in 
the second image sub-frame location (186) between times t 3 and t 5 . The 
wobbling device (104; Fig. 4) then shifts the position of the light beam bearing 
the image sub-frames such that the next image sub-frame, which is a green 
image sub-frame, is displayed in the fourth image sub-frame location (188) 
between times t 5 and t 6 . Fig. 13 illustrates the remaining image sub-frame 
location contents between times t 6 and t| 2 according to the exemplary 
embodiment. 

[0064] Fig. 14 shows another exemplary embodiment wherein the 
wobbling device (104; Fig. 4) shifts the position of the light beam bearing the 
image sub-frames such that two of the primary colors are displayed in the same 
image sub-frame location before the third primary color is displayed in a 
different image sub-frame location. Fig. 13 and Fig. 14 are exemplary of the 
many possible display sequences of the color image sub-frames as will be 
understood by one skilled in the art. 

[0065] Fig. 15 illustrates an exemplary embodiment wherein n=2 and 
m=4. In other words, there are two image sub-frame locations and four colors 
generated by the sequential color device (102; Fig. 4). Thus, eight image sub- 
frames are generated by the image processing unit (106; Fig. 4) and are 
sequentially displayed. The four colors, in the exemplary scenario of Fig. 15 are 
red, green, blue, and white. 
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[0066] As shown in Fig. 15, a red image sub-frame (1 14a) is first 
displayed in the first image sub-frame location (185) between times t 0 and t|. 
The wobbling device (104; Fig. 4) then shifts the position of the light beam 
bearing the image sub-frames such that the next image sub-frame, which is a 
green image sub-frame (1 15a), is displayed in the second image sub-frame 
location (186) between times U and t 2 . The wobbling device (104; Fig. 4) then 
shifts the position of the light beam bearing the image sub-frames such that the 
next image sub-frame, which is a blue image sub-frame (1 16a), is displayed in 
the first image sub-frame location (185) between times t 2 and t 3 . The wobbling 
device (104; Fig. 4) then shifts the position of the light beam bearing the image 
sub-frames such that the next image sub-frame, which is a white image sub- 
frame (119a), is displayed in the second image sub-frame location (186) 
between times t 3 and U- Because an even number of colors are displayed, the 
wobbling device (104; Fig. 4) does not shift the position of the light beam 
bearing the image sub-frames at time U so that the second red image sub- 
frame (114b) is displayed in the second image sub-frame location (186) 
between times U and t 5 . The alternating process then resumes and the second 
green image sub-frame (1 15b) is displayed in the first image sub-frame location 
(185) between times t 5 and t 6 , the second blue image sub-frame (1 16b) is 
displayed in the second image sub-frame location (186) between times t 6 and t 7 , 
and the second white image sub-frame (1 19b) is displayed in the second image 
sub-frame location (186) between times t 7 and t 8 . 

[0067] Shifting the display position of the image sub-frames between 
each color change allows the wobbling device (104; Fig. 4) to shift the locations 
of the pixels in an image that is to be displayed m times faster than if the 
wobbling device (104; Fig. 4) were to shift the display position of the image sub- 
frames after each of the m colors is displayed in a particular image sub-frame 
location. For example, in the examples explained in connection with Fig. 9 and 
Fig. 12, the wobbling device (104; Fig. 4) shifts the locations of the pixels three 
times faster than if the wobbling device (1 04; Fig. 4) were to shift the display 
position of the image sub-frames after all three of the primary colors are 
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displayed in each image sub-frame location. These high rates of pixel shifting 
are advantageous in many applications because high rates of pixel shifting are 
less detectable to the human eye than are lower rates. 

[0068] Returning to Fig. 4, in one embodiment, the image processing 
unit (106) includes a system timing unit (154). In an alternative embodiment, 
the system timing unit (154) is a separate component of the display system 
(100) and is not integrated into the image processing unit (106). However, for 
explanatory purposes, the exemplary display system (100) of Fig. 4 will be 
described with a system timing unit (154) that is integrated into the image 
processing unit (106). The system timing unit (154) communicates, for 
example, with the frame rate conversion unit (150), the resolution adjustment 
function (151), the image processing unit (106), the sequential color device 
(102), the SLM (103), and the wobbling device (104). In an exemplary 
embodiment, the system timing unit (154) synchronizes the buffering and 
conversion of the image data to create an image frame, the processing of the 
image frame to adjust the resolution of the image data to the resolution of 
display system (100), the generation of the sub-frames, the modulation of the 
image sub-frames, and the display and positioning of the image sub-frames. 
Accordingly, the system timing unit (154) controls the timing of display system 
(100) such that an entire group of image sub-frames are temporally and 
spatially displayed in different positions by the display optics (106) in a manner 
that correctly displays the finally displayed image. 

[0069] The preceding description has been presented only to illustrate 
and describe embodiments of invention. It is not intended to be exhaustive or 
to limit the invention to any precise form disclosed. Many modifications and 
variations are possible in light of the above teaching. It is intended that the 
scope of the invention be defined by the following claims. 
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